Maximum-Likelihood Detection of Soliton with Timing Jitter 
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Using the maximum-likelihood detector (MLD) of a soliton with timing jitter 
and noise, other than walk-out of the bit interval, timing jitter does not degrade 
the performance of MLD. When the MLD is simulated with important sampling 
method, even with a timing jitter standard deviation the same as the full- width- 
half-maximum (FWHM) of the soliton, the signal-to-noise (SNR) penalty is 
just about 0.2 dB. The MLD performs better than conventional scheme to 
lengthen the decision window with additive noise proportional to the window 
wide. 
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The Gordon-Haus timing jittesi limits the transmis- 
sion distance of a soliton communication system. The 
arrival time of the soliton has a variance increase cubi- 
cally with distance. Previously, the decision window of 
the soliton is widened to significantly reduce the impact 
of timing jitteA However, the widening of the decision 
window allows more noise entering the decision circuits. 
For example, if the decision window is doubled to twice 
wider than necessary, the amount of noise is doubled. 
The signal-to-noise ratio (SNR) is halved, giving 3-dB 
SNR penalty to the system. Using an electro-absorption 
modulator as an optical time-domain demultiplexer to 
provide a wide decision window^, the timing window may 
reach 80% of the bit interval for timing-jitter resilient 
reception^. 

In conventional detection theorj£, the matched filter 
based receiver maximizes the output SNR. The matched 
filter can be implemented optically with an impulse re- 
sponse identical to the soliton pulse shape. Unfortu- 
nately, the matched filter cannot apply directly to a sig- 
nal with timing jitter. A wide decision window is equiva- 
lent to an intergator with an integration interval the same 
as the decision window. Even for a soliton with timing 
jitter, a rectangular decision window is inferior to the 
match filter based receiver. Method to combat timing jit- 
ter without leading to significant increase in SNR penalty 
is investigated here based on maximum-likelihood detec- 
tion (MLD). 

MLD of a signal minimizes the error probability of 
the detection of a binary signal. If digital "1" and "0" 
are represented by the presence or absence of a soliton 
and assumed that "1" or "0" is transmitted with equal 
probability, MLD decides the presence of a soliton by 
p[r(i)|l] > p[r(t)|0], where r(t) is the received signal, 
p[r(i)|l] and p[r(i)|0] are the probability of having a re- 



ceived signal of r(t) given the condition with the presence 
or absence of a soliton, respectively. The absence of a 
soliton is decided if p[r(t) 1 1] < p[r(t)|0]. 

In a soliton communication system, the received signal 
can be represented as 



r(t) = a k s(t - t )e J f +n(t), 



(1) 
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where S {0, 1} for the absence or presence of the soli- 
ton, s(i) = sech(1.76f) is the normalized soliton pulse 
with unity full- width-half- maximum (FWHM), i is a 
random variable representing the timing jitter, <f> is the 
random phase due to the propagation delay and soliton 
phase jitter, and n(t) is the additive complex- value white 
Gaussian noise with spectral density of No/2. Only the 
noise with the same polarization as the soliton is consid- 
ered here by assuming a polarized receiver. The phase of 
<j) is assumed to be uniformly distributed from to 27T. 

Usually, soliton propagation with noise is studied by 
the first-order perturbation of the soliton2i£iL£ in which 
amplifier noise is directly projected to amplitude and fre- 
quency jitter. When the first-order soliton perturbation 
is linearized^, there is no difference whether amplitude 
jitter is a distributed contribution along the fiber or a 
lumped contribution at the beginning or the end of the 
fiber. For example, if n(t) — n\(t) + n2(t) with n\(t) 
and n2 (t) from the first and second half of the fiber link, 
respectively. With the small signal or linearized models, 
the projection of n(t) to amplitude and frequency jitter 
is the same as first applied ni(t) and then n.2(t), or even 
first applied n2(t) and then n\{t). Of course, if first-order 
large signal perturbation is used, there is small difference 
between the distributed or lumped model2*2*i£. The re- 
ceived signal of QJ assumes all amplifier noise at the end 
of the fiber link and is more accurate than first-order per- 
turbation for amplitude and frequency jitter if time jitter 
is included in to and phase jitter is included in <f>. 

If the soliton is detected by a photodetector, the phase 
of <f> in JIJ does not affect the system performance. With 
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Fig. 1. MLD of the presence and absence of a soliton 
with timing jitter. 



a detail provided in 5j, Sec. 7.2], after averaging over the 
random phase of <f>, the probability density of the received 
signal is equal to 



p[r(t)\l,t ] = aexp -— / \r(t)\ 2 dt - — 
' 2\[~Eq 



p[r(i)|0] = aexp 




"(t)\ 2 dt 



(2) 
(3) 



where a is a proportional constant, Iq( ) is the zero- 
order modified Bessel function of the first kind, E — 
J X s 2 (t)dt is the energy per soliton pulse, and q is equal 

to °° 



q = 



r{t)s(t - t )dt 



, 9>0. 



(4) 



If the probability density of timing jitter is Pr(~to)i we 
obtain 



p[r(t)\l] 



p[r(t)\l,t ]pT(t )dt . 



(5) 



Using the likelihood ratio of p[r(i)|l]/p[r(i)|0], the deci- 
sion rule becomes 



2VEq 
N 



p T (to)dt > exp 
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TF (6) 



for the presence or absence of a soliton with time jitter. 
In the decision rule of J()J|, the integration of |r(t)| 2 in (J5J) 
and ancl the constant of a cancel each other. 

The decision rule of JJJJ together with the parameter q 
calculated by (0} can be implemented by the block dia- 
gram of Fig. ^ The received signal first passes thought 
an optical matched filter having an impulse response 
equal to the soliton pulse of s(t). The output of the 
optical matched filter is qe?^ . The output of the op- 
tical matched filter converts to electrical signal using a 
photodetector. The photodetector gives an output pro- 
portional to the square of q 2 . The implementation of 
the correlation of using matched filter can be found, 
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Fig. 2. Simulated error probability of the MLD for soli- 
ton with timing jitter. Various markers are the error 
probability from simulation. Dashed-line is the theoret- 
ical error probability without timing jitter. Solid lines 
include the walk-out probability that the timing jitter is 
outside the bit interval. 



for example, in 5, ch. 6]. With the output of q 2 from 
the photodetector, the value of Io(2^/Eq/No) in © can 
be found. The integration in |0 with respect to to is 
again implemented using a filter with impulse response 
of prito) which output is sampled at the right time. In 
Fig. ^ the probability density of pt(*o) is n °t necessary 
to be Gaussian distributed*^ but must be symmetrical 
with respect to zero. After the sampler, the presence or 
absence of the soliton is decided when compared with 
exp(E/N ). 

Without timing jitter orpr(tn) = 5(to), the right-hand 
sided of © becomes I (2\/E~q/No)\t 0= o and the decision 

rule of © can be simplified to a quadratic detector 0, 

i 

Sec. 8.3]. The quadratic detector is q 2 < q 2 h with <? t h as 



the optimal threshold without timing jitter. With a per- 
formance the same as that for non-coherent detection of 
amplitude-shift keying signal, the performance can be an- 
alyzed by the well-known Marcum Q-functioni2*i 3 . The 
error probability for the case without timing jitter is 
shown in Fig. [21 as dashed line. The error probability 
of Fig. |21 is shown as a function of SNR, given by the 
ratio of E/Nq. The threshold of detection is calculated 
using 10 with Pr(tn) = 5 (to)- An error probability of 
1(T 9 requires an SNR about 18.9 dB. 

The performance of the MLD of © does not lead to a 
simple analytical error probability for soliton with timing 
jitter. Numerical simulation is conducted if the timing 
jitter is zero-mean Gaussian distributed with variance of 
a 2 . The simulation results are shown in Fig. [21 with at 
normalized to the FWHM of the soliton. Fig. [21 shows 
that MLD for soliton with timing jitter has very small 
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SNR penalty for a t up to one FWHM of the soliton. 

In order to investigate those cases with very small error 
probabilities, numerical simulation cannot be conducted 
directly based on Monte-Carlo methods. The simulation 
of Fig. |21 is based on important sampling, similar to the 
methods of [130. The received signal has soliton with 
different timing jitter according the Gaussian distribu- 
tion with variance of a\. The noise sample after the 
optical matched filter of Fig. ^with a time correspond- 
ing to the peak optical intensity is generated based on 
uniform distribution. Other noise samples are generated 
by Gaussian distribution with a covariance depending on 
the optical matched filter. Each error count is weighted 
according to the probability difference between the ac- 
tual Gaussian noise samples with the generated noise 
samplesifliii. Other than adding a biased noise sample 
after the optical matched filter of Fig. ^ instead of the 
actual signal with amplifier noises before the filter, the 
numerical simulation followed closely the detector of Fig. 
□ 

The error probability calculated from simulation is 
shown in Fig. fusing different marker for at from 0.1 
to 1.0 of the FWHM of the soliton. Even with a soliton 
having a large timing jitter of at = 1.0, the SNR penalty 
is just about 0.2 dB compared with the case without tim- 
ing jitter (dashed line). If a widening decision window is 
used instead, for example, at = 0.5 requires a decision 
window wide of t w w 6 such that the probability of the 
soliton walking-out of the decision window is less than 
erfc[r u ,/(2cr t v / 2)] = 2 x 10~ 9 lj. A decision window size 
of t w ss 6 gives approximately 7 dB of SNR penalty. 

Fig. |21 also shows the error probability taking into ac- 
count the probability that the soliton may have a timing 
jitter outside the bit interval when a t — 0.8, 1.0 and 
the bit interval is 10 times the FWHM of the soliton. 
The bit interval of T = 10 is chosen for convenience 1 . 
For a t < 0.8, the walk-out probability does not affect the 
overall error probability and is not shown in Fig. [21 From 
Fig. [21 soliton with large timing jitter is mainly affected 
by the walk-out probability, especially for system with a 
bit interval just T = 4, 6 times the FWHM of the soli- 
ton. Unlike the receiver with widening decision window, 
the simulation results of Fig. |21 show that the receiver 
schematic of Fig. ^does not give large SNR penalty. 

The MLD of © or Fig. □ has a filter with impulse 



response the same as the probability density of pr(io)- 
The walk-out probability depends on the tail of pr(to) 
but the left hand-sided of I© depends on the center of 
Pr(to) around its mean of to = 0. While the MLD of © 
depends weakly on the timing jitter variance of a\ , the 
walk-out probability depends strongly on a\ as from Fig. 

121 

The MLD of soliton with timing jitter is derived, to 
our knowledge, the first time. Other than the walk-out 
probability that the soliton has a timing jitter outside the 
bit-interval, soliton is not affected by timing jitter when 
MLD is used. Even with a timing jitter standard devi- 
ation the same as the soliton FWHM, the SNR penalty 
is just about 0.2 dB. The MLD has significantly smaller 
SNR penalty than detector with a widening decision win- 
dow. 
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